ON THE DYNAMIC PROGRAMMING PRINCIPLE FOR 
UNIFORMLY NONDEGENERATE STOCHASTIC 
DIFFERENTIAL GAMES IN DOMAINS 



N.V. KRYLOV 

Abstract. We prove the dynamic programming principle for uniformly 
nondegenerate stochastic differential games in the framework of time- 
homogeneous diffusion processes considered up to the first exit time from 
a domain. The zeroth-order "coefficient" and the "free" term are only 
assumed to be measurable. In contrast with previous results established 
for constant stopping times we allow arbitrary stopping times and ran- 
domized ones as well. The main assumption, which will be removed in 
a subsequent article, is that there exists a sufficiently regular solution of 
the Isaacs equation. 



1. Introduction 

The dynamic programming principle is one of the basic tools in the theory 
of controlled diffusion processes. In early 70's it allowed one to obtain results 
about the unique solvability in classes of differentiable functions of Bellman's 
equations, which, for about ten years, were the only known results for more 
or less general fully nonlinear second-order elliptic and parabolic equations. 

In this paper we will be only dealing with the dynamic programming 
principle for stochastic differential games. Concerning all other aspect of 
the theory of stochastic differential games we refer the reader to [1] , [2] , [1] , 
[llj . and [12] and the references therein. 

It seems to the author that Fleming and Souganidis in [2] were the first 
authors who proved the dynamic programming principle with nonrandom 
stopping times for stochastic differential games in the whole space on a 
finite time horizon. They used rather involved constructions to overcome 
some measure-theoretic difficulties, a technique somewhat resembling the 
one in Nisio [11], and the theory of viscosity solutions. 

In [5] Kovats considers time-homogeneous stochastic differential games 
in a "weak" formulation in smooth domains and proves the dynamic pro- 
gramming principle again with nonrandom stopping times. He uses approx- 
imations of policies by piece-wise constant ones and proceeds similarly to 

EH]. 
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Swi§ch in [12] reverses the arguments in [2] and proves the dynamic pro- 
gramming principle for time-homogeneous stochastic differential games in 
the whole space with constant stopping times "directly" from knowing that 
the viscosity solutions exist. His method is quite similar to the so-called 
verification principle in the theory of controlled diffusion processes. 

It is also worth mentioning the paper pQ by Buckdahn and Li where the 
dynamic programming principle for constant stopping times in the time- 
inhomogeneous setting in the whole space is derived by using the theory of 
backward forward stochastic equations. 

Basically, we adopt the strategy of Swi§ch (|12j) which is based on using 
the fact that in many cases the Isaacs equation has a sufficiently regular 
solution. In (T2] viscosity solutions are used and we rely on classical ones. 

The main emphasis of [2], [1], and |12] is on proving that (upper 
and lower) value functions for stochastic differential games are viscosity so- 
lutions of the corresponding Isaacs equations and the dynamic programming 
principle is used just as a tool to do that. In our setting the zeroth-order 
coefficient and the running payoff function can be just measurable and in 
this situation neither our methods nor the methods based on the notion 
of viscosity solution seem to be of much help while proving that the value 
function is a viscosity solution. 

Our main future goal is to develop some tools which would allow us in a 
subsequent article to show that the value functions are of class C 0, , provided 
that the data are there, for possibly degenerate stochastic differential games 
without assuming that the zeroth-order coefficient is large enough negative. 
On the way to achieve this goal one of the main steps, apart from proving the 
dynamic programming principle, is to prove certain representation formulas 
which will be derived in a subsequent article from our Theorems 14.11 and 
14.21 in the first of which the process is not assumed to be uniformly nonde- 
generate. Another important ingredient consists of approximations results 
allowing us to approximate stochastic differential games with the ones for 
which the corresponding Isaacs equations have sufficiently regular solutions. 
This issue will be addressed in a subsequent article. 

One of the main results of the present article, Theorem 12. 2\ is about the 
dynamic programming principle in a very general form including stopping 
and randomized stopping times. It is proved under the assumption that the 
corresponding Isaacs equations have sufficiently regular solutions. 

In Theorem 12.31 we prove the Holder continuity of the value function in 
our case where the zeroth-order coefficient and the running payoff function 
can be discontinuous. 

Theorem 12 . 21 concerns time-homogeneous stochastic differential games un- 
like the time inhomogeneous in [2] and generalizes the corresponding results 
of [12] and [I], where however degenerate case is not excluded. 

The article is organized as follows. In Section [2] we state our main results 
to which actually, as we have pointed out implicitly above, belongs Theorems 
14.11 and 1 4.21 reminding the verification principle from the theory of controlled 
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diffusion processes. The main technical tool for proving these theorems is 
laid out in a rather long Section [3] for processes which may be degenerate. 
We prove there Theorems 13.11 I3~2l and !3.31 In a short Section [4] we give their 
versions for uniformly nondegenerate case. These versions look stronger but 
Theorem 14.21 is proved only for uniformly nondegenerate case. In Section 
[5] we prove an auxiliary result which allows us to investigate the behavior 
of the value function near the boundary. In the final short Section [6] we 
combine previous results and prove Theorem 12.21 

2. Main results 

Let M. d = {x = (xi, Xd)} be a ci-dimensional Euclidean space and let 
d\ > d and k > 1 be integers. Assume that we are given separable metric 
spaces A, B, and P and let, for each a £ A, f3 € B, and p £ P the following 
functions on M. d be given: 

(i) d x d\ matrix-valued a a ^(p,x) = a (a, (3,p,x) = (crff (p, x)), 

(ii) Revalued b a,3 (p,x) = b{a,(3,p,x) = (bf{p,x)), and 

(iii) real-valued functions c al3 (p, x) = c(a, /3,p, x), f a/3 (p, x) = f(a, /3,p, x), 
and g(x). 

Introduce 

a * fax) := (l/2)a^(p,x)(a^(p,x)y, 
fix a p G P, and set 

(a,a,b,c,f)^(x) = (a,a,b,c,f)^(p,x), 

Assumption 2.1. (i) All the above functions are continuous with respect to 
f3 € B for each (a,p, x) and continuous with respect to a G A uniformly with 
respect to /3 £ B for each (p,x). Furthermore, they are Borel measurable in 
(p, x) for each (a, the function g(x) is bounded and uniformly continuous 
on R d , and c a/3 > 0. 

(ii) The functions a a ^(x) and b a/3 (x) are uniformly continuous with re- 
spect to x uniformly with respect to (a, /3) £ Ax B and for any x € M rf and 
(a,P,p) eAxBxP 

\\a^(p,x)\\,\b^(p,x)\ <K , 

where Kq is a fixed constants and for a matrix a we denote ||o"|| 2 = traa*. 

Let (Q,J-,P) be a complete probability space, let {J~t,t > 0} be an in- 
creasing filtration of cr-fields T% C Tt such that each Tt is complete with 
respect to J 7 , P, and let wt,t > 0, be a standard di-dimensional Wiener 
process given on O such that wt is a Wiener process relative to the filtration 
{Tt,t >0}. 

The set of progressively measurable A- valued processes at = ott{oj) is 
denoted by 21. Similarly we define 53 as the set of .B-valued progressively 
measurable functions. By B we denote the set of 53- valued functions /3(a.) 
on 21 such that, for any T £ (0, oo) and any a}, a 2 € 21 satisfying 

P(a\ = a 2 for almost all t < T) = 1, (2.1) 
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we have 

P{f3 t {a l ) = /3 t (a 2 ) for almost all t < T) = 1. 

We closely follow the standard setup (but not the notation) from [2], [3], 
and [12] allowing the control processes to depend on the past information 
contained in {J~t}- By the way, in the situation of controlled diffusion pro- 
cesses (not stochastic differential games) these control processes were first 
introduced in [6] and turned out to be extremely useful in developing the 
theory of Bellman's equations. 

Definition 2.1. A function p" = p™ (w) given on 21 x 53 x x [0, oo) is 
called a control adapted process if, for any (a.,/3.) G 21 x 53, it is progressively 
measurable in (u,t) and, for any T G (0, oo), we have 

P{Pt ^ = P** ^ f° r almost all £ < T) = 1 

as long as 

P(a\ = c? u $ = 01 for almost all t < T) = 1. 

The set of control adapted P-valued processes is denoted by 53. 

We fix a p G 53 (for the rest of the article) and for a. G 21, /3. G 53, and 
x G R rf consider the following ltd equation 

x t = x+ [ a asl3s ( P %P-,x s )dw s + [ b a ^ s {pf^,x s )ds. (2.2) 
Jo Jo 

Assumption 2.2. Equation (I2.2D satisfies the usual hypothesis, that is for 
any a. G 21, /3. G 53, and x G M d it has a unique solution denoted by xf 
and x^'^' x is a control adapted process for each x. 

Remark 2.1. As is well known, equation (|2.2p satisfies the usual hypothesis 
if Assumption ^. II is satisfied and for any x,y G M rf and (a, /3,p) G A x i? x P 
the monotonicity condition 

2(x - y, b a P(p, x) - b a P(p, y)) + \\a a ^(p, x) - a a \p, y) f <K x \x- y\\ (2.3) 

holds, where K\ is a fixed constant. For instance, if a a ^(p,x) and b a °(p,x) 
are Lipschitz continuous in x with constant independent of a,/3,p, then 
(|2.3p holds. If d = 1, then (|2.3p is satisfied if, for instance b a ^(p,x) is a 
decreasing function and a a ^(p, x) is Lipschitz continuous in x with constant 
independent of a, /3,p. Even if a and b are independent of p, this argument 
shows how control adapted processes may appear. 

We discuss a different way in which control adapted processes appear 
naturally in Remark 12.41 

Take a £ G Co°(lR rf ) with unit integral and for e > introduce Q e { x ) = 
e~ d C,(x/e). For locally summable functions u = u(x) on M. d define 

u^(x) = u * ( £ (x). 
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Assumption 2.3. (i) For any x € M. d 

sup (Ic^l + If^lXx) < oo (2.4) 

(a,/3eAxB 

(ii) There exist a constant 5\ € (0,1] and a function r a ^(p,x) defined 
on A x B x P x M d with values in [f^i,^ 1 ] such that r a ^(p,x) = 1 and on 
A x B x P xM d we have 

r^ P ,x) = r^(p,x)r /3 (x). 

(iii) For any bounded domain D C M. d we have 

II SUp |/ a/? | || Ld(D) + || SUp C af} \\ Ld {D) < OO, 
(a,/3)£AxB (o,/3)GAx_B 

II sup |/^-(/^)||| Ld(D) ^o, 

(a,/3)eAxB 

|| sup |c^-(c^)( £ )||| Ld(D) ^0, 

{a,/3)eAxB 

as e i- 0. 

(iv) There is a constant 5 G (0, 1] such that for a £ A, (3 £ B, p £ P, and 
x, A £ M. d we have 

5|A| 2 <af/(p,x)A i A j ^J-^AI 2 . 

The reader understands, of course, that the summation convention is 
adopted throughout the article. 



Set 

rt 

iol.B.x 

h 



fix a bounded domain D C M. d , define r a '^' x as the first exit time of 
from D, and introduce 



a.p.x 



V[X 



mi sup E^ {a - ] [ [ T f{p t , xt)e-<* dt + g(x T )e-^] , (2.5) 
geBa.eSl Jo 



where the indices a., (3, and x at the expectation sign are written to mean 
that they should be placed inside the expectation sign wherever and as 
appropriate, that is 



K P ' [ f T f(pt,xt)e-+* dt + g(x T )e-^] 
Jo 



a.p.x 



E[g(x%Z.)e-CZZ. + C ' ' r^(p^,x^ x )e-^ X dt]. 

Jo 

Observe that v(x) = g{x) in M. d \ D. 

This definition makes perfect sense due to the following. 
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Lemma 2.1. There is a constant N , depending only on Kq, 5, d, and the 
diameter of D, such that for any a. G 21, /3. G 2$, x G D, n = 1,2,..., 
t G [0, oo), and /i G Ld(D) we have (a.s.) 

I Ta .^ >t E^{{f\h{x s )\ds) n \jF t } <n\N n \\h\\l d{D) . (2.6) 

In particular, for any n = 1,2, ... 

E^ r" < n\N n . 

Proof. Estimate (|2.6p with n = 1 is proved in Theorem 2.2.1 of [7]. If it 
is true for an n, then we have 

I ra . P . x>t E^{{ £ \h(x s )\ds) n+1 \ T t } 

= (n + l)I T ^. x>t E^ {J T \h{x r )\(J T \h(x s )\ds) n dr \ T t ) 

= {n+l)I Ta .?. x>t E^- { J* \h{x r )\I T>r [E«P{J T \h{x s )\ds) n | T r ] dr \ T t ) 

< N r \n + l)\\\h\\l d{D) I ra .,. x>t E^{^ \h(x r )\dr \ JF t ) 
<N^Hn + iy.\\h\\l + J Dy 

The lemma is proved. 

For a sufficiently smooth function u = u(x) introduce 

L a/3 u(p,x) = a ( *f(p,x)D ij u(x) + b° 1 *(p,x)D i u(x) - c al3 (p, x)u(x), 

where, naturally, Di = d/dxi, Dij = DiDj. Recall that we fixed apeP 
and denote 

L a ^u{x) = L a P U {p,x), 
H[u](x) = sup inf [L a ^u(x) + f a/3 (x)}. (2.7) 

Definition 2.2. For a domain U C M. d we say that a Cf (U) function u 
is p-insensitive in U (relative to (r a/3 , L al3 )) if for any x G U, a. G 21, and 
p. G <B 

d[u(xf- p - x )e-^' P "] = r a ^(p^,x^^ x )L a ^u(x^- x )e-^'"' X dt + dm t 

for t less than the first exit time of x"'^' x from U, where mt is a local 
martingale starting at zero. 

There are nontrivial cases when all sufficiently smooth functions are p- 
insensitive (see Example 12. If) . On the other hand, any smooth function 
u(xi) will be p-insensitive if (an, b\) a ^(p, x) = r a/3 (p, x)(dn, bi) a ^(x) with 
no restrictions on other entries of a and b. A generalization of this particular 
example will play an extremely important role in one of subsequent articles. 
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Definition 2.3. Let U be a domain in M. d for which the Sobolev embedding 
W$(U) C C(U) is valid. We say that it is regular (for given g) if there exists 
a function u G W$(U) such that H[u] = in U (a.e.) and u = g on dU and 
there exists a sequence n n G C 2 (U) of p- insensitive in [/ functions such that 
n n -»• u in W|(C0 and in c ( u )- 

In a subsequent article we will show that the following assumption can be 
dropped. 

Assumption 2.4. There is a sequence of expanding regular subdomains 
D n of D such that D = U n >i 

Finally we impose the following. 

Assumption 2.5. There exists a bounded nonneg ative G G Cf oc (D) such 
that 

(i) We have G G C(D) and G = on 91?; 

(ii) For all a £ A, (3 £ B, p £ P, and x £ D 

L a ^G(p,x) < -1. (2.8) 

Here is our main result. 

Theorem 2.2. Under the above assumptions also suppose that there exists 
a sequence of functions g n such that ||<7 — g n \\c(D) ~* ® as n ^ oo, for each 
n > 1, ||<7n||c 2 (.B) < 00 5« i' 3 p-insensitive in D. Then 

(i) The function v{x) is independent of the chosen control adapted process 

it is bounded and continuous in M. d . 

(ii) Let j a -"- x be an {Tf}- stopping time defined for each a. G 21, (3 G 23, 
and x G M d and stzc/i that j a -P- x < T a -P- X _ Also let \°P X > be progressively 
measurable functions on £1 x [0, oo) defined for each a. G 21, (3 G 23, and 
x G M d and swc/j £/ia£ £/ie?/ have finite integrals over finite time intervals (for 
any u ). Then for any x 

v(x)= inf sup E% l3{a - ) [v(x 1 )e-^~^+ [' ' {f(p u x t ) + X t v(x t )}e-^ dt], 
/3eBa.e2l Jo 

(2.9) 

where inside the expectation sign 7 = j a -/3( a -) x and 

^■ x = f Xf^ds. 
Jo 

Remark 2.2. The function G is called a barrier in the theory of partial 
differential equations. Existence of such barriers is known for a very large 
class of domains, say such that there are po > and 9 > such that for 
any point xq G dD and any r G (0, po] we have that the volume of the 
intersection of D c with the ball of radius r centered at xq is greater than 
9r d . The so-called uniform exterior cone condition will suffice. 

Without Assumption 12.51 or similar ones one cannot assert that v is con- 
tinuous in D even if no control parameters are involved. 
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Note that the possibility to vary A in Theorem 12.21 might be useful while 
considering stochastic differential games with stopping in the spirit of [5]. 

Remark 2.3. Definition 12.21 is stated in the form which is easy to use and to 
check especially when (as in a subsequent article) the state process consists 
of several components for each of which the corresponding equations have 
very different forms and u depends only on part of these components. 

Still it is worth noting that, as follows immediately from Ito's formula, 
u € Cf (U) will be p-insensitive if on A X B x P X U we have 

L a(3 u{p, x) = r a/3 (p, x)L al3 u(x). (2.10) 

Example 2.1. Let O be the set of d\ x d\ orthogonal matrices and denote 
by P = (p',p") a generic point in [— 8i,S^ ] x O. Assume that the original 
a, b are independent of p. Then introduce 

o"fi(p,x) = {p') l ' 2 a^(x)p", (b,c,f)^(p,x)=p'(b,cjr^x). 

In this case 

{l/2)a aP {p,x){a ap {p,x)Y = p'a ap {x) 

and (|2.10p holds for any u with r al3 (p, x) = p' . 

In this case the assertion that v is independent of the control adapted 
process pf ' is rather natural and is due to the fact that its effect on the 
state process is equivalent to that of a random time change and a random 
rotation of the increments of the original Wiener process. 

The main advantage of introducing the above parameters, which by far are 
not the most general and important for the future, is that while estimating 
v{x + e^) — v{x) for small e, where £ £ M. d , we can take p = (1,1), where / is 
the d\ x d\ identity matrix, in the definition of v(x) and a different p close 
to (1,/) in the definition of v(x + e£). This may make the solutions of the 
corresponding stochastic equations to become closer than in the case where 
for both v(x) and v(x + e£) we take p = (1,1). 

Remark 2.4. One of ways to introduce control adapted processes can be 
explained in the situation of Example 12.11 when the original a and b are 
Lipschitz continuous. Take a [<5i, 5^~ 1 ]-valued function r(x) and O-valued 
function Q(x) defined and Lipschitz continuous on M. d . Fix an xq £ M. d and 
for a. G 21 and /3. £ 23 define 

Pt ' 13 ' : = (r(x t ),Q(x t )), 
where x% is a unique solution of 

x t = x + f r l/2 (x s )(j aaf3a (x s )Q(x s )dw s + f r(x s )b as/3a (x s ) ds. 
Jo Jo 

Almost obviously p € and the above solution is, actually, x"'^' x for that 
p if x = xq. In a subsequent article we will show a much more sophisticated 
use of control adapted processes defined by an auxiliary Ito equation. 

As a simple byproduct of our proofs we obtain the following. 
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Theorem 2.3. The function v is locally Holder continuous in D with expo- 
nent 6 G (0, 1) depending only on d and 5. 

The point is that v will be obtained as the limit of u n which are solutions 
of class W%(D n ) of the equation H[u n ] = in D n (a.e.) with boundary- 
data g. It is well known (see, for instance, Remark 1.3 in [10] ) that such 
u n satisfy linear uniformly elliptic equations with bounded coefficients and 
it is a classical result that such solutions admit uniform in n local Holder 
estimates of some exponent 9 G (0, 1) depending only on d and 8 (see, for 
instance, [3] or [8]). 

3. Proof of Theorem 12.21 in case that the Isaacs equation has a 

smooth solution 

In this section Assumptions 12.31 (iii) , (iv) , the regularity Assumption 12.41 
as well as Assumption 12.51 concerning G are not used and the domain D 
is not supposed to be bounded. Suppose that for each e > we are given 
real- valued functions c^{x) and f"^(x) defined on A x B x M. d . 

Assumption 3.1. (i) Assumptions 12. 1\ \2.2\ and 12.31 (i). (ii) are satisfied. 

(ii) For a constant x > we have c a/3 (p,x) > x for all a,/3,p,x. 

(iii) For each e > the functions (c, f)f^(x) are bounded on A x B x D 
and uniformly continuous with respect to x G D uniformly with respect to 
a, j3. 

(iv) For any x as e \. 0, 

d £ (x):= sup Eg* f T (\c-c E \ + \f-f E \)(x t )e-^dt^0. 

(Q.,/3.)62tx!B J 

(v) For any x G D 

sup E^- [ T \f(jp u x t )\e-^dt <oc. 

(a./9.)e»X<B JO 

Observe that Assumption 13.11 (v) implies that v is well defined. 

In some applications we have in mind the following "degenerate" version 
of Theorem 12.21 plays an important role. We assume that we are given two 
p-insensitive in D functions u,u G C 2 (D) (with finite C 2 (D) -norms) such 
that their second-order derivatives are uniformly continuous in D (in case 
D is unbounded). 

Theorem 3.1. (i) If H[u] < (everywhere) in D and u > g on dD (in 

case dD ^%), then v < u in D. 

(ii) If H[u] > (everywhere) in D and u < g on dD (in case dD ^ $), 
then v > u in D. 

(iii) If u and u are as in (i) and (ii) and u = u, then all assertions of 
Theorem \2.S\ hold true. Moreover, v = u. 

This theorem is an immediate consequence of the following two results in 
which we allow \^ P X an d to be as in Theorem 12.21 
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Theorem 3.2. Suppose that H[u] < (everywhere) in D. Then for all 
x G D we have 

u(x) > inf sup ^' /3(a ' ) [n(x 7 )e-^-^ 

+ P [f(x t ,Pt) + Xtu(x t )}e-^ dt]. (3.1) 
Jo 

In particular, if u > g on dD, then for 7 = r and A = equation (j3.ip 
yields that u> v. 

Theorem 3.3. Suppose that H[u] > (everywhere) in D. Then for all 
x G D we have 

u(x) < inf sup Eg-PM [u( Xj )e-^-^ 

/36B a. 621 

+ f J [f(pt,x t ) + Xtu(x t )]e-^-^ dt]. (3.2) 
J 

In particular, if u < g on dD, then for 7 = r and A = equation (|3.2p 
yields that u < v. 

Note that, formally, the value x 7 in (|3.ip and (|3.2[) may not be defined if 
7 = 00. In that case we set the corresponding terms to equal zero, which is 
natural because u and u are bounded and $%^' x = 00. 

To prove these theorems we need two lemmas. The reader can compare 
our arguments with the ones in [12] and see that they are very close. 

For a stopping time 7 we say that a process £t is a submartingale on [0, 7] 
if £t/vy is a submartingale. Similar definition applies to supermartingales. 

Lemma 3.4. Let H[u] < (everywhere) in D. Then for any x G R^, a. G 
21, and e > 0, i/tere exist a sequence f3 n (a.) = f3 n (a.,x,e) G 03, n = 1,2,..., 
and a sequence of increasing continuous \Tt\-adapted processes nf e (a.) = 
nf £ (a.,x) TOt/t riQ 6 {a.) = smc/i £/ia£ 

sup £77^ (a.) < oo, (3.3) 

the processes 

kT{*) :=u(x?)e~W t f^P^x^" ds, 

Jo 

where 

(x?,^) = K0 t r^> /p(p,x) = r^(-)( P ,rE), p» = p ?w«-\ 

(3-4) 

are supermartingales on [0,T a '^^ a ^ x ], and 

lim sup Er]™ £ (a.) < e/fax) + NdJx), (3.5) 
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where 5± is taken from Assumption \2.3\ (ii) and N is independent of x and 
e. Furthermore, if for any n we are given a nonnegative, progressively mea- 
surable process A" > having finite integrals over finite time intervals (for 
any u ), then the processes 

+ f z?) + \ n s u{x n s ) - AX £ (aV ? K^ ? ds 

Jo 

are supermartingales on [0, T a -P n {a.)x^ where (we use notation (|3.4p and) 

^=f\ n s ds. (3.6) 
J o 

Finally, 

sup sup .E sup |k"^ t (q;.)| < oo, sup sup -E sup \p^ T (a.)\ < oo. (3.7) 
a.e» n t>o «.ea n t>o 

Proof. Since B is separable and a a ^ , b a ^ , c a ^ , and f a ^ are continuous 
with respect to f3 one can replace B in (|2.7p with an appropriate countable 
subset Bq = {/3i,/?2> ■••}■ Then for each a £ A and x € D define f3(a,x) as 
Pi € i?o with the least i such that 

> L a ^u(x) + f a ^(x) - e. (3.8) 

For each i the right-hand side of (|3.8p is Borel in x and continuous in a. 
Therefore, it is a Borel function of (a, x), implying that (3(a, x) also is a 
Borel function of (a,x). For x D set /3(a, x) = /?*, where /3* is a fixed 
element of B. Then we have that in D 

> L a ^ a ^u(x) + f<*P(<*>*)( x ) - e . (3.9) 

After that fix x, define /3"°(a.) = f3(at,x), i > 0, and for k > 1 introduce 
/3™ fc (a.) recursively so that 

/?™ fe (a.) =/3™ (fc_1) (a.) for i < fc/ra, (3.10) 

/3f (a.) =p(a u xf jn ) for t>k/n, 

where x™ k is a unique solution of 

x t = x+ j\{a s ,P^ k - 1 \a.),p a s ^ h ' 1 ^ a -\x s )dw s 
Jo 

+ f b(a s ,!5f k - 1 \a.),pf^ k ~ 1) ^\x s )ds. (3.11) 

JO 

To show that the above definitions make sense, observe that, by Assump- 
tion E21 x™° is well defined for all t. Therefore, (i^ l {a.) is also well defined, 
and by induction we conclude that x™ k and f5^ k {a.) are well defined for all 
k. 

Furthermore, owing to fj3. lOf) it makes sense to define 
ft (a.) = Pf{a.) for t < k/n. 
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Notice that by definition xf = x^'^' satisfies the equation 



x t = x+ *(a a ,ff(a.),p?W a -\x a )dw a 



o 



+ / b(a s ,^(a.),pf^ a \x s )ds. (3.12) 
J o 

For t < k/n we have /3™(a.) = /3^ k ^(<x), so that for t < k/n equation 
(|3.12p coincides with (13. lip owing to the fact that p"'^' is control adapted. 
It follows that (a.s.) 

x 7 } = xf for all t < jfe/n, 

so that (a.s.) 

ft k (a.) = P(a t ,xZ /n ) 
for all t > k/n. Therefore, if (k — l)/n < t < k/n, then 

/3r(a.) = /3 t n(fe " 1) («.) = /3(«t,4-D/n) 

ft:=K(a.) = P(a 8 ,xl ii8) ), (3.13) 
where K n (t) = [nt]/n, and xf satisfies 

xf = x + J a{a s ,^{a s ,x^ n{s) ),pf,xf)dw s 

+ fb{a s ,f3{a s ,xl n{s) ),pf,x n s )ds, (3.14) 
J o 

with pf = Ps ■ 

Introduce r n as the first exit time of xf from D and set 

Observe that by Ito's formula 

/■tAr" 

?i(^ Ar „)e-^A T n = + / e -«L Qs/3 "n(K,x") ds + m™, 

where is a martingale. 
By Definition O 

n(xr AT n)e-^- 

iAr" 



r^"(p?,<) e -« ds 



o 



= u{x)+ / e-^<[L as/3 ^(x^) + r^ l (x^)](is + m™, (3.15) 

JO 

where, for s < r n , (notice the change of c to c £ ) 

+6i(o s , /9(a s , x^ (s) ),OAu(x^) - c(q s , /3(a s , < n(s) ), <)fi«) 
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= Oij (a s , /3 (a s , x n Kn {s) ) , x n s ) Dij u (x n s ) + h (a s , /3 (a s , x n Kn (s) ) , x n s ) DiU {x n s ) 

-c £ (a s ,(3(a s ,x n Kn{s) ),x:)u(x:)+^, 
where £f e (defined by the above equality) is a progressively measurable 
process such that by Assumption 13.11 (iv) 

r n 

supE \^ £ \e~^ dt < Nd £ (x) (3.16) 

n Jo 

with TV independent of a, e, and x (equal to one). All such processes are 
denoted by £f e below even if they may change from one occurrence to an- 
other. 

According to our assumptions on the uniform continuity in x of the data 
and Diju(x) we have that for s < r" 

+k(a s , P{a B , < n(s) ), x n Rn{s) ) Diu(x n Kn{s) ) 

-c(« s ,/3(a s ,x: n(s) ),^ (s) )^ n(s) ) + -*», w ) + 

where, for each e > 0, Xe{y) is a (nonrandom) bounded function on W 1 such 
that Xe(y) — > as y — > 0. All such functions will be denoted by Xe even if 
they may change from one occurrence to another. Then (|3.9|) shows that, 
for s < r n , 

L^u{x n s ) < e + xe{x n s ~ < n(s) ) + in - f(a s ,P(a s (x n Kn{s) ),x n Kn{s) ) 

< £ + Xe{x n_ + ^1 _ f^K^ 

which along with f|3. 15|) implies that 

/•Mr" 

K% Tn := u(x? Arn )e^ + / <) e -« d s - ^ = ^ + m « 

JO 

(3.17) 

where £™ £ is a decreasing process and 

/•tAr" /-tAr™ 

r?r = r?r(«0 = rfr 1 / + / e -^[\C £ \ + Xs(x^-x n Kn{s) )]ds. 

Jo Jo 

Hence nf^ T n is at least a local supermartingale. Assumption ^ . 1 1 and (|3,16D 
show that (j3.3[) and the first inequality in (|3.7p hold. It follows that the local 
supermartingale n^ T n is, actually, a supermartingale. 

Furthermore, obviously 

/■oo 

e~ ™ < 1/x, 

so that to prove the first assertion of the lemma, it only remains to show 
that 

/•oo 

sup E / e-«xe(a$ - < (s) ) & ->• (3.18) 

as n — > oo. In light of the fact that c a @ > x 5 this is done in exactly the same 
way as a similar fact is proved in [9]. 
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That p't^ T n (a.) is a local supermartingale follows after computing its sto- 
chastic differential. Then the fact that it is a supermartingale follows from 
the second estimate in (|3.7p which is proved by using 

/•oo 

/ \?e-W dt < 1 (3.19) 
Jo 

and the same argument as above. The lemma is proved. 

Proof of Theorem 13.21 First we fix x G M d , a. G 21, and e > 0, take 
/3 n (a.) form Lemma [3.41 and prove that the 23-valued functions defined on 21 
by (3 n (a.) = /3 n (a.) belong to B. To do that observe that if ([2J]) holds and 
T < l/n, then (a.s.) fit°{a l ) = /3™°(a 2 ) for almost all t < T. By definition 
also (a.s.) 

p f^) =p f^{*>) for all s <T. 

By uniqueness of solutions of (|2.2p (see Assumption 12. 2p . the processes x™ 1 
found from (|3.1ip for a. = a 1 and for a. = a 2 coincide (a.s.) for all t <T. 

If (|2.ip holds and l/n < T < 2/n, then by the above solutions of (|3,lip 
for a. = a 1 and for a. = a 2 coincide (a.s.) for t = l/n and then (a.s.) 
/3f 1 (a 1 ) = /3f 1 (a 2 ) not only for all t < l/n but also for all t > l/n, which 
implies that (a.s.) 

pfP nl (<x 1 ) =p fP n H<* 2 ) for almost all s<T 

and again the processes x 1 / found from (|3.1ip for a. = a 1 and for a. = a 2 
coincide (a.s.) for all t <T. 

By induction we get that if (|2.ip holds for a T G (0, oo) and we define k 
as the integer such that k/n < T < (k + l)/n, then (a.s.) 

ft{pt}) = Pf{a l ) = pf{a 2 ) = ff(a 2 ) for all t < (k + l)/n, (3.20) 

p a^ h (af) = p fp n H<* 2 ) for a i most a ii s <T 

and the processes x™ found from (|3.1ip for a. = a 1 and for a. = a 2 coincide 
(a.s.) for all t <T. This means that f3 n G B indeed. 

Furthermore, by the supermartingale property of p™ e (a), for any stopping 
times ^y a -^- < T a -P- X defined for each a. G 21 and /3. G 53 we have 

u{x) > ^•^ tt(a °u(x 7 )e-^-^ -Erff(a.)e^ 

+E £fr(*.) [\f(p uXt) + x t u{x t ) - \ n t ^{a)e^\e~^ dt. 
Jo 

Also observe that 

E^^l ^ \ t i/ e {a.)e-^ dt + < e (a.)e-^] 
J o 

< Ssup77™ £ (a.) < Er]^ £ (a.). 

It follows that 

u(x) > [ (\fipt, x t ) + X t u{x t )]e-^ dt 

Jo 
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+u{x 1 )e~^-^\ - Erf? {a.) 
which owing to (|3.5p yields 



u{x) > lim sup E^ n{a - ] [ [\fipt, x t ) + huixt^e-^-^ dt 

n-tooa.&H JO 

+n(x 7 )e"^-^] -e/(5 lX ) - Nd £ (x). 

In light of the arbitrariness of e we arrive at (|3.ip and the theorem is 
proved. 

For treating u we use the following result. 

Lemma 3.5. Let H[u] > (everywhere) in D. Then for any x £ M. d , p € B, 
and e > 0, there exist a sequence a n £ 21, n = 1,2,..., and a sequence of 
increasing continuous {J~t}-adapted processes n™ £ ([3) with r]Q £ ([3) = such 
that the processes 

k? := fi(*?)e-*? + rff(0) + f /T(p?, s?)e~« tfo, 

■/ o 



where 



(3-21) 

are submartingales on [0, T Q ™/3(a n ):j:j an rf 

sup^C(/3)<oo, (3.22) 



lim £?^(/3) < e/(6 lX ) + Nd s {x), (3.23) 

n— >oo 



where 6% is taken from Assumption \2.3\ (ii). 

Furthermore, if for any n we are given a nonnegative, progressively mea- 
surable process A™ > having finite integrals over finite time intervals (for 
any uj ), then the processes 

+ f [f?(fi, x?) + A>(^) - A^f (fle^e-V-*? ds 
Jo 

are submartingales on [0, T a "p{ a ") x ^ where we use notation f|3.21j) and '0" 
is taken from (j3.6|) . 
Finally, 

sup E sup |«2\ T | < oo, sup E sup \ptA T \ < °°- 

n t>0 n t>0 

Proof. Owing to Assumptions 12.11 and 12.31 (i) the function 

h(a,x) := inf \l aP u(x) + f ap (x)\ 
pes L J 
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is a finite Borel function of x and is continuous with respect to a. Its sup 
over A can be replaced with the sup over an appropriate countable subset 
of A and since 

sup h(a, x) > 0, 

similarly to how /3(at, x) was defined in the proof of Lemma [3.4l one can find 
a Borel function a(x) in such a way that 

mf [L^u(x) + f^(x)] > -e (3.24) 

in I?. If x $l D we set a(x) = a*, where a* is a fixed element of A. 

After that we need some processes which we introduce recursively. Fix x 
and set a" = a{x). Then define ccf° as a unique solution of the equation 

x t = x+ cr(af,(3 s (a n0 ), P f 0/3ian \x s )dw s 
Jo 

+ l\(af,[3 s (a" a ), P ? ^) iXs)ds . 



For k > 1 introduce a™ k so that 

af = af k - 1] for £ < k/n, 
af = a{x n k f- l) ) for t>k/n, 

n(k—l) 

where x t is a unique solution of 

, r t -, \ nffc — 1) „, nffc — 1) \ 

Jo 

+ / bK^- 1 ),^^^- 15 ),^ \x s )ds. (3.25) 

Jo 

As in the proof of Lemma 13.41 we show that the above definitions make 
sense as well as the definition 

a n t = af k ~ 1] for t < k/n. (3.26) 
Next, by definition xf = x"' & ^ x satisfies 

x t = x+ / a(a^,(3 s (a n ),pf f3{an \x s )dw s 
Jo 

+ [ t b(a^(3 s (a n ),pf l3{an \x s )ds. 
Jo 

Equation (|3.26p and the definitions of B and of control adapted processes 

show that X™ satisfies (|3.25p for t < k/n. Hence, (a.s.) x™ = x™^ k for all 
t < k/n and (a.s.) for all t > 0, af = a(a;" and 

x? = x+ (\(a(xl n{s) ),(3 s (a n U n s ,x n s )dw s 
Jo 
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+ f\(a(xl n(s) ),(3 s (a n U n s ,x n s )ds, 

J 

where p s = p s ■ 

Now, introduce r n as the first exit time of x™ from D, set 

/?r=/3> n ), w = <pf^ x , r n s =r^ n {p n s ,x% 

where r a @ (p, x) is taken from Assumption 12.31 (ii) , and observe that by Ito's 
formula 

u(x? Arn )e-^m = u(x) + / r n s L a ^^ u{x n s ) ds + m?, 

J o 

where m™ is a martingale and, for s < r™, 

Z<^«) = ^(a« n(s) ),^,<)A#(^) 

/MWO*?) - c(a(xl n(s) lP^x n s )u{x n s ). 
Similarly to the proof of Lemma 13.41 we derive from (I3.24D that, for s < r™, 

Z°M?fi(s?) >-s- X (x: - x^ w ) - r - /(a(x^ w ),)8?,x^ w ) 

= -e- X (x n s - x n Rn{s) ) - r - /^(xj), 
where £™ e are nonnegative progressively measurable processes satisfying 
(|3.16p and Xe(y) is a (nonrandom) bounded function on W 1 such that Xe{y) ~~ 
as ?/ — 7- 0. It follows that 

fiAT" 

u(x? AT n)e-^m + / / a ?^(p»,xJ)e-«d 8 + » fe B = Ct + m? ) (3.27) 

JO 

where is an increasing process and 

ftAr" /-*AT n 

% n = Vt (P) = ^f 1 / e~« + / e"« [£f + X,(^ - <„ (s) )] (fa. 
Jo jo 

Hence the left-hand side of (|3.27p is a local submartingale and we finish the 
proof in the same way as the proof of Lemma 13.41 The lemma is proved. 
Proof of Theorem 13.31 Similarly to the proof of Theorem 13.2^ for any 

/3 GB, 

u(x) < EfP (an) [ Hfipuxt) + X t u(x t ) + XtrjFWe^e-*-** dt 
Jo 

+u(x 1 )e^-^ +tf £ ((3)e^] 

< Eg ?f * a?) [ Hfipuxt) + \ t u{x t )]e~^ dt 
Jo 

+n(x 7 )e^-^] +Et T £ {0)- 

It follows that 

u{x) < sup [ Clfipuxt) + X t u{x t )}e-^ dt 

a. 621 Jo 
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+u(x 7 )e^-^] + lim E V ™((3), 

J n—toc 

u(x) < sup E^ {a - ] [ f\f{pux t ) + X t u(x t )]e-^ dt 
a. em Jo 

+u(x 1 )e^-^)+e/(8 lX ) + Nd e , 

which in light of the arbitrariness of e and (3 £ IB finally yields ()3.2f) and the 
theorem is proved. 

4. Versions of Theorems 13. 1L 13. 21 and 13.31 for "uniformly 
nondegenerate" case 

In the first result of this section D is not assumed to be bounded. 

Let u, u G W 2 i oc (D) n C{D) be given functions for which there exist se- 
quences u n ,u n S C 2 (D), n > 1, of p-insensitive in D functions which for each 
n have uniformly continuous second-order derivatives (if D is unbounded) 
and such that u n ,u n converge to u and u, respectively, uniformly in D. For 
a sufficiently regular function u we denote by Du its gradient and D 2 u its 
Hessian. In case of u, u we take and fix any Borel measurable versions of 
their gradients and Hessians. 

Theorem 4.1. Suppose that Assumptions \2.1\ QQ| II?. 31 (i). (ii), Assumption 
\2.5\ (ii), and Assumption \ 3.1\ (Hi), (v) are satisfied. Also suppose that a 
stronger than Assumption \3. 1\ (iv) is satisfied, namely, for any x 

sup Eg-* [ sup (\c af3 -cf\ + \f af3 -ff\)(x t )e'^dt^O. (4.1) 

(a.,/3.)eax<8 JO a&A,l3eB 

as e X 0. Finally, assume that for any x £ D 

sup Eg* [ (\D 2 u-D 2 u n \ + \Du-Du n \){x t )e-^dt^Q (4.2) 

(a.,/3.)G2lx<8 JO 

as n —7- oo and the same is true if we replace u with u. 
Then the following holds true: 

(i) If H[u] < in D (a.e.) and u > g on dD (if D ^ M. d ), then v < u in 
D and (13. ip holds for any \°P X an d ^q-.^.x as ^ n Theorem \2.2\ . 

(ii) If H[u] > in D (a.e.) and u < g on dD (if D ^ M. d ), then v > u in 
D and (|3.2p holds for any \°P X an d ^ a -P- x as % n Theorem ] 2. 2\ 

(Hi) If u and u are as in (i) and (ii) and u = u, then all assertions of 
Theorem \2.2\ hold true. Moreover, v = u. 

Before we proceed with the proof we note the following. 

Remark 4.1. For x £ M. d and u = (u',u"), where u' = (uq,^, ■■■,u' d ) € ]R rf+1 
and u" is in the set S of d x d symmetric matrices, introduce 

H(u,x) = sup inf (a$(xK j + ^bf(x)u? i -^(x)i4 s + f a f > (x)). (4.3) 
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Owing to Assumption 12. II (i) one can replace A and B with their countable 
everywhere dense subsets. Then we see that H (u, x) is a Borel function of 
x. 

Also note that 

d d 

\H(u,x)\ < AT(£ K\ + E I^D + Kolsupc^(x) + sup|/^(x)|, 

\H(u, x) — H(v, x)\ < \u' — v' \ supc a ^(x) 
d d 

+iv(E 14-41 +EK-^)> ( 4 - 4 ) 

i,j=l i=l 
where N is independent of it, v, x. In light of (j2.4|) the right-hand sides are 
finite, which, in particular, implies that H(u, x) is a Borel function of (u, x). 

If, in addition, c a/3 (x) and f a ^(x) are bounded and continuous with re- 
spect to x uniformly with respect to (a,/3), then the inequality 

d d 

\H(u,x)-H( U ,y)\<N\x-y\(J2 Kj\+^K\) 

i,j=l i=l 

+ \u' \ sup \c a ?(x) - c a ?(y)\ + sup \f^{x) - f a P(y)\ 

a, /3 aJ3 

shows that H(u,x) is a continuous function of x, which along with (|4.4p 
guarantees that H(u,x) is a continuous function of (u,x). 

Proof of Theorem 14.11 (i) Introduce h n = H[u n ], 
cf(p,x) = c^(p,x) + n- 1 r a ^p,x), 

ff(p,x)=f^(p,x)-r^(p,x)h n (x) + n- 1 r a ^p,x)u n (x) 
= r°0(p, x)[f^{x) - h n (x) + n- l u n (x)l 

Lfu(p,x) = L afS u(p,x) - ?i- 1 r Q/3 (p,x)n(x). 

Observe that u n is p-insensitive in D with respect to V^f ■ Owing to 
Definition 12.21 this follows from the fact that (dropping the superscripts 
a.,(3.,x) for any x € D and t < r, we find that the coefficient of dt in the 
stochastic differential of 

u n (xt)e~ 4 '", where 4>t = [ c^ s (p s ,x s ) ds, 

Jo 

equals e~^" times 

L atl3t u n (p t ,x t ) - n~ l r atl3t (p t ,x t )u n (x t ) 

= r a ^(p t ,x t )[L a ^u n (xt) - n~ l u n (x t )] = r a ^(p u x t )L^u n {p u x t ). 
Furthermore, 

sup inf [Lfu n (p,x) + ff(p,x)] = 0, 

a&A /3eB 
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which makes us try to apply Theorem 13.21 for each n. 

Define h ne = H e [u n ], where H £ is constructed in the same way as H with 
c £ and f e in place of c and /, respectively, and observe that, for each n 
and e > 0, h n is a Borel function on D and h ne is bounded and uniformly 
continuous in D (cf. Remark 14. ip . Also in D 

\h n£ -h n \ = \H £ [u n ]-H[u n ]\ < (1+supKI) sup (|c^-cf \+\J«P-ff\). 

adA,paB 

Therefore, for any x 

lim sup E£ p - ! \hne - fr re |(x t )e _< ^ dt = 0. 

(a.,/3.)62lxQ3 JO 

All other assumptions of Theorem 13.21 are satisfied in light of the as- 
sumptions of the present theorem and the fact that we added n~ l to c. By 
Theorem 13.21 after setting 

C p - X = f )d.s 

Jo 

we obtain 

Un(x) > inf sup Eg- pM [u n (x T )e-^-^-^/ n 

/3GB a. 621 

+ f{fn{pt,x t ) + X t u n (x t )}e-^-^ n dt] . 
Jo 

Now we note that by considering G + 1 in place of G we may assume that 
G > 1 on D. We set G := 1 outside D. Then, as follows easily from Ito's 
formula, the process 

rt/\T 

G(x tAr )e-^ AT_ * AT + / (1 + A s )e-^-^ ds 
Jo 

is at least a local supermartingale, where 

{x t ^ t ,T) = (x U <j )u TY-P- X , & = $^ 

and x, a., and (3. are arbitrary. Nonnegative local supermartingales are 
supermartingales. Therefore, 

E£-£ e -*r-^ + ^■ /3 ' T(l + A,)e-*'-^ < G(s). 

JO 



This shows that 



v> n (x) > inf sup Ex [tt(x 7 )e 



7 



+ / {/(pt,x t ) + A^(x t )}e-^-^- Ct/n dt] 

JO 

- (n -1 ^ 1 sup |tt n | + sup \u n — u\)G(x) — K n , (4-5) 



D D 



where 



K n (x) = 6± 1 sup E^- f\h n (x t ))+e-^dt. 

a.S2t,fl.G ( B Jo 
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Observe that 

(h n )+ = {H[u n }) + < (H[u n ) - H[u})+ < N(\D 2 {u n -u)\ + \D(u n - u)\) 

+ \u n — u\ sup . 

Here for any e > 

sup 6^ < sup |c Q/3 - cf\ + sup \cf\, 

a,{3 a,/3 a,/3 

which along with our assumptions imply that K n — > 0. After that by letting 
n — > oo in fj4.5j) we come to (|3. 1 j) . Equation ()3. 1|) with 7 = r and A = 
implies that u > v. 

(ii) Here the proof is very similar and yields (|3.2p , from which we conclude 
that u < v. 

(iii) The combination of assertions in (i) and (ii) leads to u = u = v, then 
(13. ip and (I3.2D imply that -y satisfies (I2.9D and, since u n ^ u = v uniformly 
by assumption, t> is continuous in D and in M. d . Finally, since u and ii have 
nothing to do with the fixed control adapted process pf ' 13 ', the function v is 
independent of the choice of this process. 

The theorem is proved. 

The assumptions of Theorem 14.11 admit an easy verification in the uni- 
formly nondegenerate case. 

Theorem 4.2. Suppose that the domain D is bounded, all requirements of 
Assumptions \2. i\ \2.2[ and \2.3\ are satisfied, andu n andu n not only converge 
uniformly in D but also converge in W^(D) to u and u, respectively. Then 
all assertions of Theorem \4-l\ hold true. 

Indeed, the existence of a global barrier is well known for bounded do- 
mains and uniformly nondegenerate operators with bounded coefficients, 
so that Assumption 12.51 (ii) is satisfied. Furthermore, in (|4.ip we can take 
(c £ , f £ ) = (c^ £ \ f( £ ') owing to Assumption l2.3l (iii) and Lemma [2. 11 The same 
lemma guarantees that (14. 2|) holds and therefore Theorem 14. II is applicable. 

Remark 4.2. One may think that Theorem 14.21 is the only "reasonable" 
application of Theorem 14.11 However, in a subsequent article we will see an 
application of Theorem 14.11 to a situation where u depends only on part of 
the coordinates of a diffusion process, which does degenerate at each point, 
but the above mentioned part of it is uniformly nondegenerate. 

5. An auxiliary result 

In this section D is not assumed to be bounded. We assume that we are 
given a continuous J-t-adapted process xt in W 1 and progressively measurable 
real-valued processes q and ft- Suppose that q > 0. 
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Assumption 5.1. There exists a nonnegative bounded and continuous 
function $ on D such that the process 

rfAr 



/•tAT 

$(x tAT )e-^ + / \f s \e~^ds 
Jo 



is a supermartingale, where r is the first exit time of xt from D and 

ft 

c.9 ds. 



o 



Let D(n), n > 1, be a sequence of sub domains of Z). Introduce T n as the 
first exit time of xt from D(n). 

Lemma 5.1. We have 

E [ T \ft\e-* dt < E$(x )I Xo eD, (5.1) 
J o 

E I |/i|e" 0t dt < sup $ (sup := 0). (5.2) 

Jr n (dD n )\dD 

Proof. By assumption, for any t € [0, oo), 

rthT 

E[^(x tAr )e~^ + / \f a \e-*' ds] < E$(x ), 
Jo 

E / \fs\e~ 4 " ds < E[$(x ) - $(xt Ar ) e -^] < E<f>(x )I T>Q , 
Jo 



and sending t — > oo leads to (|5.ip . 

Again by Assumption 15.11 for any T € [0, oo) we have 

fTnAT 

E[$(x Tn/sT )e-^T + / |/ t | e -^dt] 
J o 
i-tAT 

> E[$(x TAT )e-^T + / \f t \ e -<h £ft ] j 

J o 

/■rAT 

/ |/t|e" 0t ^ < S[*(x Tft AT)e-^ AT - $(x rAT )e-^ r ] 

= E[<l>(x TnAT )e-^T _ *(x TAT )e-^AT] /Ttt<r 

< £$(av nA T)/ r „<T. 
By sending T — >• oo and using the monotone and dominated convergence 
theorems we arrive at 

E Hftle-^ dt < E$(x Tn )I Tn<T 

Jr n 

and (|5.2[) follows. The lemma is proved. 
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6. Proof of Theorem 12.21 

In this section all assumptions of Section [2] are supposed to be satisfied. 

So far we did not use Assumption 12.51 (i) concerning the existence of G 
vanishing on dD, which we need now to deal with the case of general D. 
Take an expanding sequence of smooth domains D n C D from Assumption 
12.41 and introduce 

v n (x) = inf sup Eg-P™ [ f( Pt , xt)e-+* dt + g(x Tn )e~^], 

/3SB a£2l JO 

where Tn'^' x is the first exit time of x"'^' x from D(n). By Theorem 14.21 we 
have that v n are continuous in R d and 

v n (x) = inf sup Eg-PW [v„(z 7 Je-**-*»' 

/3£B a. 621 
fin 

+ / {f(pt,xt) + \ t v n (x t )}e-^-^dt], (6.1) 
Jo 

where = y*-y3(«0* A 

We claim that, as n — > oo, 

K n := sup \v n — v\ = sup \v n — v\ — > 0, (6-2) 

which, in particular, would imply the continuity of v and the fact that v is 
independent of the choice of pf ' ■ 

To prove (I6.2p introduce v m and v nm by replacing g with g m in the def- 
initions of v and v n , respectively, where g m are taken from the statement 
of the theorem. Observe that, obviously, sup n \v n — v nm \ + \v — v m \ — > as 
m — > oo uniformly on Therefore, u>/ii?e proving (|6.2p we may assume 
that ||fi'||(7 2 (D) < 00 an d 9 is p-insensitive. 

Then notice that in such a case we have 

[ [ T f(Pu z t )e~* «« + ff(x T )e~^] 

JO 

= ff (x)+^ [ T f(p t ,x t )e-^dt, 
Jo 

where 

/^(p,*) := [/^(p,x) + r^(p,x)Z^(x)]/ D (x) 
satisfies Assumption 12.31 (i)-(iii). Hence, 

u(x) := v(x) — g(x) = inf sup Ex'^ a '^ / f(pt,Xt)e~^ t dt. 
/3£B ae2l Jo 

This argument shows that we may also assume in the remaining part of 
the proof of (JO} that g = 0. Then 

u„(a;) = inf sup H f{p u x t )e~^ dt. 

/3£B ae2l JO 
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Next, by using Ito's formula, for any a. 6 21, j3. G 03, and x £ M d , we find 
that the process 

rtAr 

G(x tA r)e-^ T + / e-^'ds (6.3) 

JO 

is at least a local supermartingale, where 

(xt,<k,T) = (x t ,<k,r) a ^ x . 
Since G is nonnegative in D, the process (|6.3p is a supermartingale (constant 

Now, for x > introduce 

AT X = sup |(/ a/3 )W| 

(q,/5,i)6AxBx» 

and observe that by Lemmas 15.11 and 12.11 

\v n (x) - v(x)\ < I n (.x), 

where 

I n (x):= sup E^- f \f{p u x t )\e-^dt 
^f 1 sup [ T \f(x t )\e-^ dt 

<S^N X sup E%-P- I e'^dt 

a.e2l,/5.€?B Jr n 

+ sup f \f - /W|(xi)e-^ dt 

a.e»,/le93 Jo 

<<5r x iv x sup c+iviisupir^-(r^)W|ii Ld{D) , 

(dD n )\dD a,/3 
where AT is independent of n, and x. This and the fact that G = on <9D 
certainly imply (|6.2p . 

After that UETJ (cf. (l3~T9]l ) yields 

> inf sup E£ [ - /3(a0 [u(s 7W )e - ^'-^ 

+ / {f(pt, x t ) + \ t v(x t )}e~^-^ dt] - K n . 
Jo 

We use estimates like 

\v(x Jn )e-^-^ -v(x 7 )e-^-^\ = Ir n<1 \v{x Tn )e~^-^ -u(s 7 )e - ^-^ | 

<2/ Tn<7 sup |u(st)|e-* 

te[r„,r] 

J T n <-y M v ( x t)\e dt < I Tn<1 sup |v(xt)|e _< P*, 

•^7n t£[r n ,r] 

where and sometimes in the future we drop the superscripts a., /3. , and x 
for simplicity. 
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Then we see that 



v(x) > inf sup Et^ {a - ] [u(x 7 )e-*T-^ 
+ / {/(pt, a*) + \ t v(xt)}e-<«-** dt] -n n - J n (x), (6.4) 



7 



where 

J n (x) = I n (x) + 3i? n (x), 
^(x) := sup Ef p -I Tn<1 sup |«(x t )|e - ^. 

(a.,/3.)e2U93 te[r„,r] 

To estimate R n (x) we observe that, by Lemmas 15.11 and 12.11 for x 6 D 

\v(x)\<5^N x G(x)+e( X ), 

where 

eft) = N\\ sup |/^ - \\ Ld{D) _> 0, 

as x 4- (uniformly with respect to x). Furthermore, since G{xt^ T ) exp(— ^ At ) 
is a supermartingale, we have 



where A" is an absolute constant, and since v is bounded, 



E^-I Tn<T sup [G(x t )e-^] 1 / 2 <iV[ J E;^/ r „ <T G(x r Je- 

te[T„,rl 



E^-I Tn<T sup |«(x t )|e-** < NE^-I Tn<T sup [|u(x t )[e-^] 1/2 

tG[r n ,r] *6[r n ,r] 

< NN X [E«J- I Tn<T G{x Tn )] 1/2 + iV £ V2 (x) > 

where the constants iV are independent of Xi n > an d By assumption 
G = on <9-D and therefore we have that 

sup E^I Tn<T G(x Tn )^0 

(ai.,/3.)e%X<B 

as ti — y oo (uniformly with respect to x). It follows that 

Em #„(x) < Ne 1/2 ( X ). 

n— >oo 

Above we have also proved that 

lim IJx) < Ne 1/2 (x)- 

n~ >oo 

It follows now from (16.41) that 



v(x) > inf sup ^• /3(a ' ) [u(x 7 )e - ^-^ 
+ f\f(j>ux t ) + A tV (x t )} e -^-^ dt] - A^x), 

JO 
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which after sending x 4 finally shows that v (x) is greater than the right- 
hand side of (12. 9ft . The reader understands that the opposite inequality is 
proved similarly and this brings the proof of the theorem to an end. 
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